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AB8TFACT 

An introduction to protocol and training materials is 
presented in pert I of this document. Emphasis is placed on protocol 
and training materials, evaluation of outcomes, and further steps to 
be taken. A thr«e*item bibliography is included. Part II develops and 
clarifies the topic of concept portrayal as it applies to the 
production of protocol materials. The analysis of concepts, didactic 
issues in protocol developsient, and four stages of episode 
development in the production of protocol materials are discussed. A 
four^item bibliography is included. (NJM) 
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Foremml 



Th« two articlM which foMow con*t:tute the substance of Issue #1 of a new publication series de- 
voted to protocol and tmining matertals. the first two of the numerous major concepts developed in Teac/ierf 
for th0 Worfd. As clearly and convincingly as these two ideas were presented, it was Impossible to have 
anticipated the kinds of problems, clarifications, and extensions needed once efforts were mounted actually 
to produce prototypical materials. After two year's experience in the production of protocol materials 
and one year's experience with training materials, definite progress is t)eing made, both conceptualYy and 
with respect lo production and evaluative processes, h is time to begin reporting out the results. 

The first article by or>« of the most experienced producers of these kinds of maierials deals with the 
problem of definition and the relationship of definition lo production. The author. David Qliessman. has ex- 
tensive exporionce in the production of teacher training materials generally and ts one of the pioneers in 
the development of protocol and training materials. 

The s«cofHJ article looks at the very complex problem of taking a concept through all of the develop- 
mental stages from its beginning on the pages of a textbook or in the mind of a developer, to its final 
state as protocol materials. The author, Bryce b. Hudgins, also is emminently qualified to undertake this teak 
by virtue of both his lengthy history as an educational paychologtst. and as one of the original contractors lo 
produce protocol materials. 

From the star>dpoint of the editorial board, a primary objective of tt>e publication series is to orovide 
an outlet for idaas about protocol and training materials in teacher education. Over the series the aim is 
dialogue and discussion among producers, consumers, and critics with these articles as the initisi stimuli. 



L. D. Brown, ^d^for 



An Introduction to Protocol and Training Materials 
David Cllessman 
Indiana University 

Professionals in teacher education have been as energetic (perhaps 
the word is profligate) as any other educators in the production of 
materials. Anyone who is on several publisheri^* mailing lists must be 
impressed by the number of textbooks that enter the market each year. 
One major publisher alone lists well over two hundred titles of avail* 
able textbooks in teacher education. The most recent Catalog of edu- 
cational motion pictures (1970) available in the Film Library at Indiana 
University lists approximately five hundred motion pictures in some as- 
pect of professional teacher education. When one adds to this the var*- 
ious specialized materials (for example, progranned learning materials 
and multi^nedia units) produced by such agencies as development labora- 
tories, the number of material resources becomes staggering rather than 
simply impressive. 

In light of this abundance, one 1^ a bit zeluctant to argue for 
more — unless it is clearly evident that certain important goals in teacher 
education art not well served by existing materials. It is possible, in 
fact, that a bias does exist in this general array of materials (with 
soaie notable exceptions, of course). This bias seems clearly to be to- 
ward informing , in some sense of that word. Informing the teacher about 
data, concepts, issues, methodologies and skills seems to be the major 
purpose of much existing instructional material. Goals in the preparation 
of teachers, on the other hand, go far beyond the informational. The 
acquisition of operable teaching skills is surely a universal emphasl<^ 
in teacher education programs. Competence in the less observable acts 



2 



of diagnosis, interpretation and evaluation is a hoped-for outcome of 
most teacher preparation. Yet the means of achieving either of these 
goals have been rudimentary at best. One has little confidence, to be- 
gin with, that a sufficient number or variety of well-conceived mater- 
ials exist for the attainment of goals such as these. 

It was to the problem of achieving interpretive competencies and 
operable skills that B.O. Smith addressed himself when he identified a 
need for "protocol materials" and "training materials" in teacher edu- 
cation. (Smith, 1969, 1970) Ideally, he viewed the preparation of 
teachers as including two ve.y general programmatic components: a theo- 
retical or conceptual component and a methodological or skills component. 
The first of these has as its aim the development of interpretive compet- 
encies. These competencies are based on the acquisition of a functional 
understanding of philosophical, psychological and social concepts as well 
as concepts from the basic fields of knowledge (e.g. language, biological 
sciences, the arts). The second component has as its aim the development 
of the specific skills that are involved in teaching. These might include, 
for example, skills in questioning, in conducting class discussion, in 
test preparation, in evaluation and assessment. Practically speaking, it 
is probably not wise to push the distinction between these ^wo components 
too far; in the reality of teacher preparation, such differential outcomes 
cannot be neatly arranged. However, the point of the distinction seems 
sound: chat in any teacher education program, the acquisition of both 
interpretive competencies and specific skills should be major emphases. 

Accomplishing either of these objectives is no small order. One will 
not find an explicit strategy for doing so in Teachers for the real world 
nor anywhere else for that matter. Smith's point simply was that newly 
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conceived and newly specified materials would be important in the develop- 
ment of any programmatic efforts to accomplish these objectives. Specifi- 
cally, he identified a need for protocol materials to be used in the theo- 
retical or conceptual component and training materials to be used in the 
methodological or skills component of teacher preparation. The conceptions 
behind each type of material are different and it is one of the purposes 
of this paper to introduce the characteristics of each. It is not alto- 
gether clear at this point, however, whether protocol and training mater- 
ials will ultimately assume different forms or serve entirely distinctive 
purposes. It is simply too early in the process of development to tell. 
Hopefully, in the discussion that follows, the evolving nature of each 
type of material will be evident. 

Protocol Materials 

Protocol materials were originally conceived to be a documentary 
record (on audiotape, videotape or film) of the actual behavior of teach- 
ers and pupils in classroom and other school settings. This documentary 
material was to serve as raw material for interpretation using concepts 
basic to teacher education (for example", psychological, social and peda- 
gogical concepts). The result of such interpretation would presumably 
be a more complete understanding of these concepts (because they would 
have been related to their referents in behavior) and an increase in the 
ability to use them interpretively , In a sense, protocol materials were 
to be a means of conjoining concept and behavior in an interpretive act, 

A little thought tends to support the general reasonableness of this 
conception. Many of the concepts that form the substance of professional 
teacher education refer to behavior. That is, they are intended to des- 
cribe or interpret actual behavior. Yet nhe means of treating these con- 



cepts have been largely verbal, through printed material and classrooni 
discussion. If teachers are to develop the ability to use concepts inter- 
pretively, however, verbal instruction alone is almost certainly insuffi- 
cient. There roust be an opportunity to observe and interpret on-going 
behavior using concepts in a systematic way. The purpose of protocol 
materials is to provide such interpretable , on-going behavior. In fart, 
Smith apparently used the term in the sense of an "original record*' of 
behavior or behavioral events. 

Beginning with this conceptual framework, the Office of Education 
began the development and production of protocol materials approximately 
two years ago. Initially, ten university-based projects were funded to 
develop pilot protocol materials based on a variety of psychological, 
sociological and pedagogical concepts. Not surprisingly, in retrospect, 
the actual process of developing such materials has turned out to be a 
decidedly more complex matter than was originally anticipated. In fact, 
the complexities of development have been the substance of a series of 
intensive meetings beginning with the inception of USOE funding and in- 
volving all project directors. 

The developer of protocol materials is faced with a two-fold problem, 
an analytic one and a technical one. He ignores either at his peril. To 
put the matter all too simply, he must find a way to clearly exemplify a 
well defined concept or set of concepts in an audiotape or notion picture 
film of high technical quality.. In this process, the developer may go 
wrong at any one or all of several points. One can, without apology, ad- 
mit the occurrence of a full range of 'Vrong movM" in the pilot projects 
dvring the past two years. 

In the analytic realm, the developer is faced with the problems of 
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selecting concepts that have some fencrality, utility and interpretive 
power; framing explicit definitions of the concepts that he does select; 
identifying the significant dimensions, components and behavioral attri- 
butes of his concepts; specifying situations to be taped or filmed that 
will contain unambiguous examples of these concepts. This is no small 
order of tasks which is probably one reason why such a level and refine- 
ment of analysis is not typically devoted to concepts in teacher educa- 
tion. One of the unexpected results of the protocol effort so far, In 
fact, is what it has revealed about the ambiguity of some of the working 
concepts in teacher education. At the same time, it has become clearly 
apparent that such a systematic analysis of concepts is at the heart of 
developing valid and useful protocol materials. Ultimately, each de- 
veloper must conscientiously attempt to conduct such an analysis of the 
concepts upon v^ich he has tentatively decided to base his protocol ma^ 
terials. One of the obstacles to fulfillint; this requirement, however, 
is that the dimensions and standards of such an analytic process are not 
widely understood in teacher education. For this reason, a careful ex- 
ploration and explication of this analytic process should be the subject 
of continued discussion and writing. 

Somewhere between this major task of analysis and the technical 
problems of actual production, the developer is also faced with a pro- 
blem in instructional design: deciding upon a format for his protocol 
materials particularly with reference to the complexity of the behav- 
ioral situations that he tapes or films. It is clear by now that the 
original conception of protocol material as an unedited documentation 
of behavior was an imperfect one. "Critical" behaviors do not always 
occur with sufficient frequency or clarity in on-going situations to 
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be "captured" by means of documentary techniques. In one way or another, 
the developers of the pilot materials have found it necessary to assure 
the occurrence and to increase the salience of the behavior exemplifying 
the concepts they have selected. This has been accomplished by various 
means including more or less subtle "staging" of events, judicious edit- 
ing of the tape or film and the use of titles or labels identifying cri- 
tical behaviors. The use of such techniques has certainly modified or 
broadened the original conception of protocol materials. However, this 
change has generally resulted from the experience of attempting to pro- 
duce protocols that are conceptually clear. The philosophical and instruc- 
tional implications of this change may well deserve continued analysis and 
discussion. 

Thinking in terms of ultimate instructional strategies, a few deve- 
lopers have moved to the production of very brief film clips in an attempt 
to further isolate critical behaviors. The protocol project at Indiana 
University, for example, is concentrating on the development of protocol 
films in two forms: (a.) film clips that as clearly and "cleanly" as 
possible exemplify a given concept and (b.) somewhat longer films of com- 
plex behavioral events that are Interpretable in terms of a set of such 
concepts, lujs, the learner mtfeat be introduced to the concept of "ap- 
proving" or "accepting" reactions on the part of the teacher by viewing 
a number of brief clips simply showing teacher reactions to pupil responses. 
These clips will be carefully selected to exhibit different dimensions jf 
approval or acceptance by a number of different teachers in different class- 
room settings. Once having acquired the concept, the student would be in 
a position to recognise examples or instancea of it in longer films when 
the critical behaviors are embedded in more complex clasaroom interaction. 
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Furthermore, he would presumably be prepared to identify some of the ante- 
cedents and outcomes of approving or accepting pupil responses in short, 

to incorporate the concept in a broader interpretive act. One might assume 
that such a progression ^rom simple to complex porcrayals behavior vould 
lead to a surer acquisition of the concept. This is an assumption that 
can and should be tested empirically, however, using carefully designed 
protocol materials. 

Finally, the developer must attend to the problem of producing mater- 
ial of high technical standards. Patently "home made** tapes and films 
will not do. The developers of the pilot protocol materials have in large 
measure rejected the naive assumption that users will overlook technical 
inadequacy and lack of authenticity for the sake of having "conceptually 
sound" materials. Fortunately or unfortunately, the professional con- 
sumer probably reacts to technical quality as quickly and surely as he 
may to conceptual quality. The fact that the developer is producing ma- 
terials that are unioue conceptually does not allow him to "beg" techni- 
cal standards. Having agreed that high technical standards are desirable, 
the task remains of specifying what these standards should be. This leads 
inevitably to questions of sound quality, picture quality and the means 
of assessing each. 

Further technical questions concern the choice of specific media 
and 9 equally important, the "mixture" of media to be included in a single 
set of protocol materials. An especially vexing problem here concerns 
the place of printed material. Thus far, developers have tended to de- 
pend upon printed material (in copious quantity) as the instructional 
support for their protocol materials. The wisdom of doing this» in terms 
of obtaining wide and effective use of protocol amterial';, is certainly 
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TroloUg Motor loio 

Uoilko tHot of protocol Mtorloio. tHo coocopt of trololi* Mtorlolo 
U Mt o ooi# ooo oiroo lo toodior oAocotloo. THo ooo ol Mtorlou opocl- 
flcollT «oolfooi to oM lo tho oc^loltloo of okliio Mo o loo^^ ^roiltloo 
lo lotfootrloi 004 sliltory trololog oo'woll oo lo oMcotloo. lo toocMr 
oMcotloo. o vorloty of trololrg Mtorloio li*vo Moo proio c oi ^ oolvor- 
oltloo* MvolopMOt cootoro oM roflOMl ioMrocorloo. TMoo aotorloio 
Mvo Moo 4ool#Mi to M mm4 lo tM ocfoUltloo of oocH oMlU oo ««oo- 
tloolof* rroooototloo of oohjoct Mttor» ooMoctlot i^iff Mi aotlirot- 
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forMt oitMn^i tMoo tMt oro Mro vUoiy tflotriMtoi tOMrolly frovlM 
fllMi OBOOpt— •t tM okiil lo OOMMt, TM MiU oooi iMloM MtlM 
plctoro fllo. priotoi Mtorloio • oMlotopM ooi oiUM. ■■noti tM olillio 

lOMiVM lo tOOCHlOt MMTOM. lOIMpUMAf OM^ifi^* Mi MOMtlOliy 

oMlMolfloi* It MoM M itfflMit to Jiii«o Mv ooaproMMlM tiMM MlOf 
l«t Mtorloio oro omo If tliojr Mro ooapi^Miy ootoiofMi. OM foM tM 

ioaiM iy to tM oliilo trootoi. ioM of tM mm vl4#iy iUtrlMCM of 

EKLC 



9 



tkM« Mt«rl«ls* for nmp I0 , cuncmlrate on a rather 1 ' Migh 

mot lMlf»lf ic«nt) sot of classroom intoractlon » 

A rocMt vonturo In th« production of traim cn,it 
umimftBkmm by tlio HotloiMil Contor for tho DovolopMiit ot TrainlnR M«trr* 
lals U TMclior Uucatloci bMod at Indiana Unlvoralty. Undor Offlc* of 
UncAtlM fiMidinf» MMctatM of tha national Caatar ara dava loping 
tralalM Mtarlala for tNa ac^ulaltlon of taachlng akllla ranglnft fro* 
'^Mktnc dravlnta that tMch"" at tha alaaantary lav«i to "taachlng lor 
Mstory** at tha aoco^dary laval. Savaral othar fundad projacta ara pra* 
aastiy Invaatlgatlng araaa dlractly ralatad to tha davalopatnt ol train* 
Ing MtorUla. A prajact at tha Unlvaralty of Nlaal (irorklng within tha 
rUrldA ftata C aMartty) la attaaptlng to doacrlba and catalogua tha 
avallAla tralalat Mtarlala In taachar adycatlon. A ralatad projact 
at PUrUa Stata Milvaralty la 4avaloplng a claaalflcatlon ayataai for 
c afa t aa c y haaad taachar aditaatlaa. Plnally* afforta ara halng sada 
at a aatlaaal laval ta hagla a caaprahaaalva Idaatlf icatlaa nt tha algal- 
flcaat aaaaapta aad ahllla ta ha lacarparacad la taac h ar acacatlaa. 

fkm 4immtm far aaalytlcal tharaaiMw Md tachalcal praflclaacy 
ara aa aaacral la tha davalapaaat af tralalag aatarlala aa thay ara la 
tha davalapMaat aC pratacal aatarlala. It aaaaa claar that aay taach- 
lag ahlll ta ha aa^alrad thraag^ tha aaa af tralalag aatarlala aaat ha 
aaaiyaad aa aarafally aa ara caaca^ta la tha caaa af pratacal Mtarlala. 
Maally, a ahill ahgald ha aalactad la tarM af lu ■aMrallg^lllty aad 
atllltyt tha MUatad ahlll ahaald ha apaalflad aad daflaad hahavlaraJ lyt 
flaally it chaaU ha aaalyaad far lu t iapiatita acMirtiat m caaaafta 
ara aaalyaad far thalr 4iMMlaM aad attrlhatM. UltlMtaly, aM af 
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Ch« Mjer IfMtrucCional functions of training MtcrlaU ChMMclvca alghc 
b« that of prMontlng cloar oxaapiM or Inatancos of the coaponenCii of a 
coaplox tMchlng skill. 

StatMMto of technical apoclf leatloiM and atandardu im ippii- 
cabU to training matorlaia aa thoy ar« to protocol natorlals. Training 
Mtarlals ar« llkaly to Includ* a varUty of M41a and, one* again, the 
(M41a «*s«d should not fall short In technical quality. An ln^ortant con- 
aids radon In ths cholcs of asdla for both training and protocol aacsr- 
lals Is that of distribution, ••cauns of csrtaln technical characCerla- 
tlcs of specific asdla and bscauss of csrtaln habits of aodla ussra. mamr 
typos and ■Uturss of nodia ars probably aors saslly dlstrlbutsd than 
othors. Ths ssctlngs in which training aatsrlala ars to bs ussd, coo, 
should have seas Influoncs on ths aodla finally sslsctsd. It is apparsne, 
than, that ths analytic and technical tasks In the develepsMnt of craln- 
Ing Mterlals are net dlssluUar to those Involved In the develep«snt of 
protocol Mterlals. 

However, Che deelgn of a forvec for eralnlnt Mterlals Is likely 
f present Che developer vlth som sniw oeokloM. Unlike the act of 
Interpretation (which is sessntlally a uHpaitlvs preceeo) , the act of 
perfervlng a cenplex teaching skill nlgst mii involve social and psycho- 

■ecer preceesee no well ae cofaltlve pr FurthenMre, it Is gsn- 

srnlly agreed Chet perfer«ence and feedback en ene'e perferMnce Is a 
crltUal slsMnt In skill acquisition, rinnlly, cIm rang* skills In- 
volved m teaching vary greatly In nature and eaaplaslty. guch charac- 
cerleClcs ef teaahlag skllU and skill aa^lsiciaa saaa to call for a 
caaoUerahU degree ef lanavaClea and aaM*iM*tatlaa In Che daslyi of 
cralnlag ■atarlaia. Only a haglMilng aaaM ca have haaa aada U fUttng 
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eh« forsae of training aatcrials Co the special conditions and processes 
involvad in acquiring a coaplax skill. 

Evaluation of Outconcs 
Tha uaa of training satarials is clear 1 to oMaaurabl* out- 

coMS. Sine* tha aaphaais in such matari on ovart or ob- 

aarvabla akilla, tha problaa of evaluation ia graatly aiaplifiad. At 
tha Beat alaaontary laval, tha evaluation taak conaiata of noting whether 
or net Che learner can d em o n strate a given teaching akill in, perhapa, 
a slaulated aetting auch aa alcroteaching. Aa long as a akill ia defined 
and specified behaviorally , It ahould be poaaible to observe its oreaencc 
with soM degree of reliability. 

It ia a bit aurpriaing, howover. to note that tha aasM enphaaia on 
■oaaurable outcoaao has charactariaoa the developMnt ^f protocol aater- 
iaU tmm tim ai^MiUif . In thia com*, after all. one a dealing with 
elH ki^ of oo^Am coffiitive procoos which haa often a-^couragod attaapta 
m ovote«tio». Hawovor, the earljr mmhmia on a carefuj aoalyaia of the 
I— capt I to «ood ia protocol aatoaaola did wtch to lay a foundatioo 
for obioctive ovolMtioo. If a c oae— t coo bo dofinod aod ita attributoo 
U bohovior 14oatifiod. the oc^iaitte ef that concopt ia potontialljr 
MaowroblO' TIm t«Mral ^vootioo for ^waliiatioo ia lAeCher or not Che 

looTMr cm roliobly i4o«Cify iooc of a coocopt in aere aad leoa 

iipltw bolMvtorol ootciat*' 

It ia hii^y dooirable Chat ciiia aa^uioicloa of oaaoofU aad akilU 
wMtf Miw ooadicioao chat are ao aoor ao f —tmm to a "real 

MOO 04 il^ltii porfocMMe. ao tedleabod obovo. Mo lapiicacioo of 
a Moaifloacioa U thoc cho Uoaaor vill bo coiioo opoa to porfon 
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thm skill in at ImsC a siaulated classrooM or group sstting. In the 
CM« of concept acquisition, the inplicstion is that the Issrnsr will 
be celled upon to identify instences of e concept in teped or filmed 
recordings of behevlor rether then In -rfnted deecriptions of behavior. 
The use of printed seteria regarded mm en adjunct evalu- 

ation device at best. In either case, it is deer that considerable in- 
novatiou ie called for in devising a fonsat for eveluation. Once again, 
especially in the case of concept acquisition, the develops^nt of the 
needed e/aloation inetruaients and strategies is only at a beginning 
stage. 

In fraite of the isiportance and complexity of the above tasks, it 
ebould b«r Mderstooc that aaemesing the acquisition of a epe Ific c ^ 
cefC or e»:ll is onl^^ a first ^cep in the Imtwm problem of evaluaf 
in rpretime competemce and ^«eching comperemce. Of course, the unde> 
standing of concepts is the eeis of interpretive cempetence just as 
specific ekille ere l omp amenta of teaching performance in a larger se 
Hevever, et eome point, evnluation nust be direcud at theee nore con- 
plek levels jf perforaance. In the caee of intespretive competence, a 
meana muat be devised to determine if the Uarmnr can uee a eet of ac- 
quired concerta in a nam eemi lex interprmtive arc; in the caee of skill 
ftcquiaitanm* a nenns nmec %n iee i ee d to enssss a lnnmer*e performance 
in uaing m fct 1 I s apprepriateiy end flexibly vitkin a Urger teaching act. 
inch levels of emnluntion wii^ ebviouely depend on tbe development of 
eophietoceted inetrumnnte and methods of evalunCien. 

Itoxt Stepe 

It ehonXd be eppnrent by mam iihy thie pnpnr hae attempted to do 
little more ckan provide en incrodMtion to pemcneol and training mater- 
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lal8. Th€ state of the knwitfui^e about each is Introductory at best. 
The specif Icat ions for eadi t^^e of material are tentative, the exist- 
ing Mterials can only be ref^arded as first approximations, problems 
of utilisation have only beei co^ched upon, the attempts at evaluation 
are at a baginning level. If protocol and training materials are to 
aake a significant contrib«Ki<n to th< preparation of teachers, two 
needs are clearly in order. First, there must be a continued develop*- 
sent of concrete protocol jmmi training materials. Actual production 
is important not only foi sstraducinR needed materials into teacher 
education programs but bn mmm ♦^ch accomplistammnt and each misstep 
clarifies future possib^. «cjm mtd directions. It is probably ccmnter- 
product ive» in any case, ^ Mm^im\ p r u^ ction pending definitive tate* 
ments; exparience vith arr^m prodiKrta is inmtrumentai in sha^Liu de- 
finitive srsresieots » In Obr came tdf protocol materials, for emmvple, 
■nch of the early specular imr aari diecmasion about their **prapmr form** 
p n mmd to be academic eaoe mrtmml i^^twlals were available for evelu* 
atimm and ua«. 

On the other hand* a vn t m immm ^am^mr for theme involw in mater- 
iala productiom is tho toMMcy to focus entirely on their pvo<mct». 
The roault la that problm» ^eCimttlon are given litrle ett—c ien, 
PraUflSM of ■aterlala opmoa cmeiM», of productive demmlop— i i ■ 1 stra*- 
tofiaaf of evmluatlve pn^ ammas ami vlterla mm solvmd but amkf for 
tkm ^odmcmr amd ramain a icad ^ **fvlmte staok** of kmowla^ to be 
raMocovorod hjr other ^m^amam^ The ameldaaoo af this state of affaire 
mast ha c asw a priaary aaaa mmmi paaaalvely. cho second point tnon is 
tkmt it la npially clear iMt Mar* maar he coat tmuous writlag and dis- 
caaatea of the roarepraal, m^^m^ ^i. AavelapMatal baaae for each type 
of aacwlal. XfttalllfMa pl«a»im mm prodactlaa caMot occur alchaat it. 
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The Portrayal of Concepts: an Issue in the Development 
of Protocol Materials* 
Bryce B. Hudgins 
Graduate Institute of Education 
Washington University 
St. Louis t Missouri 

Th« purpoM of this paper is to d^elop and clarify the topi of con- 
cept portrayal as it applies :o the preauction protocol materials. It 
is not our purpose to delineate the na: :re of irattocol materials h-^re, but 
a few Hords about that concept seem to je in onter, sisply to place our 
diacuaaion in an appropriate cmtext . A prot^cal is essentially tk« por- 
trayal of a concept. In the pr — ent c—c , mmctx a concept would be T>erti-- 
nant to taachar aducatioo, eitker a cargpt atom the subject matter the 
taachar daala with, or a concept: abo«c tMching itaalf . Furthermore the 
portrayal of a coocapt means soMthiiie other than a dictionary defM^tion 
of the label given to the concept. For our pupmae, the portrayal xnvolvev 
layint out, throu^ a aeriea of epiaodes, the ome or more characterwtica 
that, tot«ther, exemplify the cmmcept to be pvrtrayed. If, for exaaple, 
one were going to develop a proeocol of the aamcf t meeltive reinferce— it 
as part of a pmychelogical foumAmtiona compomettt of temcher educaeamn, all 
the elementa that mtm critical to the concept wmmld have to be pestaayed 
in the flaiahed pncecol. Thus, we would want acenee or dialoguea that 



Thia paper la hmBmd upon an a4dreaa given at the rrotocol Production 
Workahop, MicMpM State Oniveraity, Beat Lanai^^ Michigan, October, 
1971, under ap«Bmrahip ef the Bureau of EducatAmmml Peraonnel Develop- 
Mnt, now known m the National Center for the u>a»ant of Educatiemml 
SyataaM, U.S. Office of Education. 
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illustrate the following events and sequences: (a) the occurrences of 
the responses » (b) the rewarding or reinforcing stimuli which follow the 
responses, (c) repetition of elements (a) and (b) » (d) switcl^ t 

ie« «iUcU recreate e^PWts hifchly similar to those in (a), and (e) 
switching to responses similar to those in (a). Of course, one or even 
all of these stages might have to be repeated la the iicvelopwent of the 
protocol. That would be a Mtter of judgment regarding the didactic, 
or teaching demanis of the protocol. Similarly « the portrayal sketched 
above uould probably not exhaust the meanings of the concept "positive 
reinforcMent'*. There probably never comes a point beyond which an ab- 
stract concept camot be further developed. Evon with these disclaimers, 
the se^once of events above, if they were fulfilled with clear and ap- 
propriate examples of the elements or subconcepis indicated, would pro- 
vide at least a first approximation to the idea mt the portrayal of a 
concept. Although there are other factors that anter into the ultimate 
success of a protocol, concapteal issues are a csstral consideration, 
and a first consi^ration. mare is probably no time during the develop- 
ment of a protocol that conceptual issues can be ignoaod. The educational 
value of what amergos, through %Aatever medium the daoaloper finally set- 
tles upon, cannot a ncoo d the ^allty of concaptualisatlon that has gone 
into itt no matter hav fine the tochnical prodoction may be. 

What ktmds of oiitcomes amar^e from analyste of concepts that are of 
use to pro^mcol davalapors? Tbare seam to be tlwoe bmsmd topics in the 
conceptual realm that dm^lopars nmat oork «ttli im pratecing protocol 
■mtarlals. Thama arm: (a) analytic teauaa^ Cii 4MmctU: isa«iaa, and 

(c) OOtCOMS. 
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Before we turn co these issues, let us introc' e a fev terms that 
mi iht be widely adopted for discussions about protocols as a problem in 
concept analysis and concept teaching. Psychologists have re^rted so 
mmrn^ studies of concept learning over the pwt fifty years tdkmt the liter- 
ammmm abonods with multiple terms for similar references. Throughout this 
pmm^ a smII set of **middle of the road** tervs are used to speak about 
ta; terms that do not commit us to any particular systematic posi- 
Thus, an eaample of a concept is simply a concrete representation 
of bmhavior which has a given label associated with it. An example might 
be m brief bit of classroom interaction in which the teacher reacts in a 
g$mmm way to SMie response from a student. Our example may be either 
lwm:tlTe (meaning that it is a case of the concept we wish to portray) , 
or mmgi^iw (meaning that in one or more aspects the example does not 
fHrtrsf the concept). Concepts may have multiple dimmsions ^ To hare 
a ]H>sitive example of a concept would require that all the reqmisite di- 
MBsions of the concept be portrayed. To illustrate, when teachers **ac- 
o^pc** some behavior from a student* we would ordinarily anticipate that 
tms dimensions of the concept must be involved. One of these is a dimen- 
sion of rating on the part of the teacher. The other would typically be 
a diawmsion of responding by the pupil. 

To svoid confuaiom at thia point, let us try two simple smamplss. 
is a positive example of **teaclisr accepting reactism**. 
F: The a^glea of a triangle aM up to IM tecrees. 
T: Good ftmr you! That's exactly right! 

Ihm sboire awmple is positive hasanms •lie pmpil has clsarly raepsndad 
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in his behavior, and the teacher reacts with a ratin g. The following 
example is negative for **teacher accepting reaction*'. 
P: How do you solve Problem 8? 

T: I know you'll find a way. You* re a good student. 

***** 

Although the teacher's reaction is {generally constructive and en-- 
couraging, it does not imply acceptance of the student's behavior. Neither 
is the statement by the student a response. If these distinctions sound 
minimal, remember that one of the purposes in producing protocols is to 
remove conceptual ambiguity that often intrudes into discussions of class- 
room behavior. 

A final term we will use for talking about concept examples is value . 
Most dimensions of concepts can have more than a single value. One way 
in which values of a dimension can differ is in the form of behavior in- 
volved; for example, verbal versus non*verbal« Let us reconsider the 
first positive example above in an altered context. 

The sceoe is a junior high school mathematics class. 
A boy working at the board computas the magnitude of 
each angle of a triangle. He then writes on the board 
'180 degrees'. The teacher smiles, touches the boy 
lightly on the shoulder, and nods his head. 
Those term may be useful in thinking about the concepts to be por- 
trayed in protocols. What the dineneiona, and irtiat their values, la a 
question to be answered through analysis of the ipecific contsnt or con- 
cept to be portrayed. 

Let us more fully elaborate the three major questions of the dis« 
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cuaalon: (a) analytic Issues (b) didactic Issues, and (c) outcomes. 
Analytic Isaum are those that one confronts when he moves from the 
point of haviag Identified a concept to be translar.ed Into a protocol 
to the point mf considering the range and types of behavior to be cap- 
tured In order to fully and fairly portray It* Key analytic questions 
are the specifications of the dimensions and values of the concept. 
Subordinate biit very time-consuming and demanding questions concern 
the propertlem of wiuiples, both positive and negative* The purpose 
of this phase of conceptual analysis has nothing directly to do with 
efforts to mfliB the protocol teachable. Its purpose* rather. Is to 
make the best possible effort to Insure that the classes of examples 
to be searched for will represent the concept comprehensively and ex* 
haustlvely • 

Didactic iMueSt on the other hand, are those that compel us to 
grapple with ^mmetlona of the complexity of our examples, sequencing 
of examples, Mmlpolatlng the range of discriminations the learner 
must make, def imi;tions, and descriptions of the concept to be taught. 
If thla phMe of ttm conceptual development is well done. It should 
eventuate In a ceaiprehenelve Identification of the scenes or episodes 
that must km pemdummd, or selected from film, or otherwise generated 
to conatruct tke fiaishmd protocol. It cannot, of course, specify pre- 
cisely the mnkmr mt mpimmdes of each kind that will be raqulred, but 
beyond that, i*mm IM* •smte has been completed, most cf the questions 
about noodod e«tem4me sbemld be answerable. 

Decisiome akmmt the omtcomes for learners will be Instrumental in 
determining thm ar m iu a t mi complexity of the eplsodaa that compose the 
protocol, tetmeama for pmmtocols could be set at any number of levels. 
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but ordinarily there would be two chief onea. They might repr ent an 
intermediate and a final level for any protocol, or the developer might 
choose to shoot for only one or the other. At one level, the learner's 
task is simply to identify examples of the concept. In effect, an example 
is given, and if the learner correctly identifies it as a positive example, 
the task has been learned. Clearly, this is not a single level but many, 
and the criterial questions can range anywhere between requesting identi- 
fication of a simple, clear positive example earlier seen and identified 
as such to new examples never seen before, with high background noise, in 
which fine discriminations are required from the learner, and so forth. 
However, in both cases, the developer is still in the position of clearly 
identifying the episode to be tested, and asking the question, ''Is this 
X or isn't it?" We would undoubtedly have much greater confidence in the 
Judgment coming from the second case than the first, but it is still a 
question of the structure being imposed by the developer. 

A second level which, like the first, represents numerous sub-levels, 
is established when the learner views an extended segment of the film, or 
reads a lengthy passage of classroom transcript, or whatever it may be, 
and identifies and makes use of the concept or concepts of the program to 
analyze (interpret) what has transpired during that instructional interval. 
When the learner can perform at this level, there would be little question 
that he has an understanding of the meaning of relevant classroom behaviors 
St the conceptual level. This would seem to be a high level and desirable 
state of affairs that represents the objectives of the protocols program. 
It is an outcome distinctly different from an outcome of training, and it 
in no way warrants the ability of the learner to construct or to perform 
the behavior illustrated in the protocol. To the extent that we believe 



teachers should be able to conceptualize and to analyze instructional 



practice* such outcomes vouxd seem to be of the first magnitude of im- 
portance. 

The Analysis of Concepts* 
Analysis of a concept involves laying out the several component 
parts that most concepts worthy of protocol development «ire likely to 
have, identifying those parts, the conditions under which each occurs 

or its correlates, the events that predictably follow it, or its con- 

* 

sequences, and a consideration of the relationships between or among 



* Our discussion of the analysis ot concepts undoubtedly contains many 
assumptions, but there is one of which we are particularly aware, and 
which must be explicated at the outset. There are numerous ways in 
which concepts can be developed (produced, as contrasted with analyzed) 
that are not considered in this paper. The principal reference through 
out is to empirical analyses of concepts. Uhen one is in the process 
of developing new concepts, as is often the case in basic research, 
empirical analysis is not possible, or at any rate would contribute 
very little to the investigator's purposes. The assjmption being made 
in this paper is that the fundamental purpose of j)Totocol materials 
(and the saaie would be true for training materials) i» to teach con- 
cepts that are of sufficient importance to merit inclusion in proRiams 
of teache^ education . One implication of that assumption is that most, 
perhaps aix, of the concepts selected for development in the national 
protocols program will have been the object of considerable attention 
by research workers or educational developers. On the one hand, this 
should guarantee the protocol developer a body of empirical knowledge 
to draw on for his purposes, and on the other, its absence may alert 
him to question whether his concept is sufficiently well established 
to compete in the conceptual marketplace with other more fully develop- 
ed concepts in teacher v^ducation. Not all of th^^ current programs 
share this assumption. Probably alternative conceptual models will be 
needed for those programs. The purpose in identifying the underlying 
assumption here is to call attention to such differences and such needs 
and not to argue for the exclusion of what in some cases are excellent 
and provocative materials. There are areas of knowledge in which the 
concept of empirical analysis as used here is not very meaningful. 
Teachers of literature, for example, may have a commonly held concep- 
tion of the "psychological motivation of a character" which would suc- 
cumb to analysis of a sort similar to what is called empirical analysis 
in this paper. 



th« various cMipontntt. Surh analysis it ons of tht prollmlnary actl* 
vltlta that tha davalopar muil undartaka, and It la a Mat challanglng 
ona. Tha oriantatlon that ptrvadaa thla analyala It not ona of **how 
to portray** tha concapt, although parhapa no davalopar worthy of hla 
kaap can avar a tray vary far tron that primary praoccupatlon. Rathar 
tha concarn during thla phaaa la for tha quaation, **Vhat doaa tha con- 
capt look lika In ita antiraty?** Thla concaptual analyala la a blua- 
print froai vhlch tha davalopar will build hla protocol. If tha analyala 
la faulty t ha may vlnd up vlth a protocol that only partially portraya 
tha concapti or which la inconalatanti or ovarlapa and can ba confuaad 
with another cone apt. 

To puraua tha notion of tha concaptual analyala aa a bluaprlnt, 
lat ua taka a concapt, attaaipt an analyala of it, and aaa what kind of 
a bluaprlAt wa arrlva at whan wa hava flniahad. 
^Irical Ittidv of tha Ci^ti^mit 

Tha coDcapt wa hava choaan for analyala la '*taachara* accapting 
raactlora/* In ganaral. tha concapt covara thoaa altuatioM whara tha 
taachar graaU a atataaant by a pupil irlth an aspraaaioo, gaatur^. or 
atataMAt of hla mm that Indlcataa arpraval* aacamrajaaiaat , praiaa* 
or aaM ochar poaitiva raactiaa to tha pupll*a eoatrihtttlam to daaa 
iataractiom. It alao ineltt4aa caaaa la which tha taachar miaat corract 
or dUagraa «rith aaM or all of tha eomtamt of tha €hili*a roMrk. hut 
at tha aaM tiM eaMMieatM hia MvilliagMaa to rajMt tha pw^il^a 
offortt aai a imitm to aootiMo tha aMOMtor. 

Omo va hava i4amtifiotf tha foooral 4aMia ia which tha ccMoyt 
raai4aa» vo iaMiiataly hafio to aak ahathar thara la iafacMtiao Aroad 
that will OMhlo M to 4iMMioMliaa tha caa c apt ia aoM praiMtiva 



way, and to Itarn lomothiriR about Um oicurrence and form in the ronl 
world of ttaching that would hi> iniportant to know as we undcrt«iko thi* 
davtlopment of a prutocol. Uhm kind of information would fulfill 
thaat functiona? 

Empirical atudita of rlannroom behavior would seem to be a firHt 
domain to bt axaminad, and within it, particularly lystams that have 
attampttd to analyza what the teacher does verbally or otherwise vis 
a via tha apokan language of children. 

Although wa ahall be deeply involved here in a conaiderat ion of 
the work of Arno Ballack and his associatea as it hcipa ua to analyze 
tha concapt before ua» we must make claar the mora general point. Most 
concepta that ara aalactad for protocol developnant are concepts that 
Involve human behavior. In turn, auch behavioral concepta ordinarily 
have baan tha aubject of at least some empirical inveatigatlon in the 
paat. Ona of tha firat productive stepa the developer aa analyst can 
take ia to axamina appropriate empirical aourcaa for information about 
hla concept. That examination can provide two klnda of information of 
a ppaltiva aort, and a third kind that may be negative. Of the firat 
two, tha davalopar can laam what the baaic dimanalona ara of hla con- 
capt » and aomathlng of the relative fraquency with which tha concapt 
occura in its varioua forma. Such infonsation ahould have great impli-- 
catlona for tha relative amphaaia ultimate red in tha protocola 

that ara latar to ba davalopad. Aa a derive jk the foregoing, tha 
davalopar may alao bagln to form aoma hunchaa a b emt tha madia ha may 
cliooaa for aoma or all of hla %fotk on a particular concapt. For axampla. 
If empirical aourcaa Indicate that the kmy Infonsation about tha concapt 
la raraly ro mau n lcatad through Intonation, voice Inflection, or non* 
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verbal b«h«vior» such as facial axpraaaiona and gaaturaa, the developer 
night elect to avoid viaual or audio media altogether. Conversely, his 
empirical data sources may also help him to decide that film is indis- 
pensible to his portrayal; that without it, the development of his con- 
cept must necessarily be restricted and incomplete. 

On the negative aidei categories developed for pirposes of research 
are frequently abstract and» obviously, conceptual « as opposed to con- 
crete and illustrative. Not only are they unlikely to be a good source 
of examples of the concept, %#hich is a particular problem for the de- 
veloper, but they are often not helpful in determining the boundary lines 
between various values of the same dimension of a concept, or between 
dimensions thea»elve4. This suggests that the developer frequently will 
need to engage in reliability studies similar to those the researcher 
conducts, as he begins to build libraries of examples of the concept. 

To return once again to cases, this test of empirical sources works 
very well for the present concept. Although other inquiries could be 
consulted as well, the paina taking classroom study by Arno A. Bellack 
(1966) and hU associates, reported in The lansuate of the classroom . 
Is an extresMly informative and helpful source for purposes of the pre- 
sent anMlysis. 

In the first place, the concept, teac her's accaptly rmaction a, 
can be placed into a broader frasMwork of concepts used to analyse 
teaching. An examination of Bellack*a work reveals that classroom 
language ia categorised into four kinda h are XMelled 

structuringt soliciting, respondingt and reacting. Alaoat 40 per cent 
of all movea that teachera make in the clasarooai are claaaified aa re- 
acting movea, and they account for about 45 per cent of the vorda 
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teachertt dpear ctually line- 
thing), Thest latistics an 
tor the empir il importance' 
repertoire. 

Reacting moves turn out 
"rating". Rating reactions, It 
which Eellack labels as "posit, 
ing", "not admitting", and "neg 
moves that our concept of "teach* 
several of these types of ratings 
and vc shall have to proceed to 
to see whether we will ultimatel^ 
class of examples or episodes to 
ing reactions". 

The first four types hav* r**/» \ 
tive", "admitting", "repeating 
then, that for a reasonably 



ript, which amounts to the same 
iLise they provide ^r«iphit' support 
moves as a tool in tho toachor's 

ral types, one ot which is 
ju, consist of some six types, 
-itting", "repeating", "qualify 
It is within the domain of rating 
epting reactions" falls • Yet 
seem to qualify as "accepting", 
what is meant by each of them, 
to incorporate more than a singl* 
the concept of "teacher's accept 

elements to them; i.e., "posi- 
ualifying". We would suppose, 
ration of the concept the developer 



would be required to include th>*^ tour types, for each contributes some 
ntw dittenaion to tha concept. This does not, of course, rule out the 
poasibility that protocols would also b« davalopad which depict the "not 
adnitting'* and "negative" forms, but the grounds for doing so would be 
didactic, not having to do with the analysis of the concapt £er se . 

Furthar parusal of the data that have baan obtained about teachers* 
rating behavior may posa a dacis^o^ -making occasion for the developer • 
If "quelifying" ratinga are co. to be negative, aa Bellack con- 

atruea them, then SOX of teacher ratings are positive. If "qualifying'' 
Mveei on the other hand, are cone trued as poaitive, aa we have done 



12 



#, th«n ••^^^ing t^ii..*^ rat^Afs occur nlmmmc »3X the time that 
•^n«rs r«« mpil behmiv- Po^iltlve, admit tx^, «m repeating each 
tcoiint for ^roximatielv IT ^ teacher's ^nu reactions. Qua 
ratinffs occur apprcni^». ^; of the tint* 

imilariy, Lhc dav«i s to consider the circumstances under 

h the behavior occu a . occasions thmt forth accepting 

ratings by rhe LmmumM rwceptually , tkMR can be numerous of 
t ^ For ejcMple, 'Mmt : jt^^t^^ in discourse, some physical actio: 
a*» conceivably ds tnt a&ioT rating reactions. Indeed, these 

events do occur, but th^ ■■ ■ ■ ■ v is so low (a camibined 3%) that the 
developer Muld naed tr chtm^ i:»^efully about including such protocols 
in his display, even tJmmk^i *n be argued that the concept will be 

incompletely portrayed wiikwrt: ari^ntion to such examples. In the same 
^eln, reactlAg moves atw . «t «s4 or elicited by al four kinds of the 
moves that constitute tli^-aKare ^tam of classroom language: struc- 
tajTing, soliciting, rmmf mu md ocher reacting novM. However, two- 

>:hi:rds of reacting mcmm^ mt^ asioned by responding svvea, and another 
i-fourth by other raw na g . m9^. Leas than eight pmr cant of reactions 
preceded mad callmrf fMsm ^ structuring and soliciting mo^mM. dm 
terther statistic: swat afrak^mtimm^ a reacting mow follows a single 
wacading mmm. More than oae mm precedes a reacting nova in only 7Z 
ai the canas recorded ^ laltorfcr 

M»«t Smm all this add nr - Doea it tell the ii i ilopar anythinv 
te^eada ani samta tm teav ataiK tiaa analyaia of hla Maaapt, ahich in 
I, will «MM.e kin aa nsAa a ataga^v^ portrayal of fit M a nsHMnl? 
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concept. In the first piav 

must b incorporated into . 

portravfed, for full illuf^t^ 

ne basic dimensions Jt r^tc 



gested adultional dimenr 
on of it ixxd which mu- 
/oncept . 

reactions^ ire now seen 



that 



ne 



"positive", "admitting", rcp^* ib" , a "qualif .ng'\ Each oi cn^se 
mutft be taught. Furthennac* t' : ea jn of imterest will almc-r .ilways 
occur in a brief cycle that tnc^ o» »t movt, : ...'wed by the r action. 



The occasions when more char, a 9. 
enough that we would probab^v nci" 
they could represent a confuftin^ € 
larly, although ratings occotf 1& m 
moves, they follow respondiaft tmti r 



eced ing niovt i nvolved irt* rare 
upon portra' J>f them, in fact, 
in portray iu -he comTcpT . Simi- 
:cion wits all ^^sc kinds of basic 
racing moves with such hi^ fre- 



quency that those sequencial ^^AL.oMaxps must be portrayed. 



An additional kind of info 
in che didactic phase of pi 
"not admitting" behaviors r 
be portrayed, and such negat 
process of teaching the cone 

Befora vn conCimia to 
Ifliportattt iaaua raaialns to be 
In othar than the wipirical mm^ that na ii«ve 
triad to atraaa tha algnlf JiMsa «t aap*rlcal 



*m tLMS been ahtainau. also, txrr use 
ttie prctocol. rhat is, "negative" and 
Blivaeive exMples of the concept to 
wfum play a significant rale m the 





behavioral science that have been more thoroughly analyzed and stodle 

Yet there Is not the classroom counterpart of the analysis 
forcement that we have seen in the present case. It would seem paxsr. 
foolish to suggest that reinforcement ought not to be portrayed a^ . 
protocol on those grounds, since at a guess, virtually all educatxc3<4a. 
psychology courses incorporate, or might incorporate the concept, —1114, 
their teachings. What sort of analysis would be productive In suci . 
case? 

Of course, one solution to this problem is for the developer t. u 
precisely what we have done with ''teacher's accepting reactions", a 
that is to make an empirical analysis of reinforcement as it appear ^ 
research literature. The resulting protocol might show laboratory mr. - 
mals, such as rats or pigeons, undergoing the shaping of Instrumental 
responses, or it might recreate experimental situations for condltio«a'«t 
particular verbal behavior, motor responses, the treatment of stutterrir: 
autistic behavior in children, or other situations in which intensive 
experimental studies of reinforcement have transpired. However, if rn^ 
developer's purpose Is to portray the concept in action in the i liuisi st , 
an alternative kind of analysis must be undertaken. In such a case, tm 
must take the basic components of the concept, which of course are w«ii 
known, and b^t^n to ask questions about their manifestation in classnsw 
situations. From this analysis by analogy, some interesting observsctams 
should rssult. For ome thing* the developer would probably succeed to 
being a great deal mssm concrete about the nature of classroom reinfmmw- 
ment than momt tsxtbmmks or tmmcher education programs ever become, 
ly, ve sMpsct he would cooclmds at some stags that the valuss of tl 
cept manifsst thamssMrss differently in the classroom than in the 
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box, Mni his jrrm^mcol vould have to port:«v choM differences. 

A fitud ccmmmat ^ this analyt:.cal twtse cat^^trne the great pccen 
for the Improveaait o: our knowledge abc- leachiag ttLat can ^c-me fr - 
the development en protocol materials. ni* o: tr- weaknesses of Tcanv i^r* 
cepts in teacher education besides their ^o^ofl^n . 1- our lack of uns^^ 
ledge about their consequences. We knov . 'or -sMpXe, that in Lri>orat n 
sectingSt reinf orcement is defined in tertto^ of its consequences, as a 
stimulus that increases the likelihood of recirrrence of the response nrnat 
it follows. If reinforcement is portrayed m zhe naturalistic settini )t 
the clMsroov, iie should have an ideal laboratory for observing it 
sequences in the complex social environinent geiscnted by a grouf) o: <M^jdxrmn 
and ttelr teacher. The same thing can be said about '*teacher*s acceptin«( 
reacti^ans", and «ost of the other lAicepts that are being developed into 
protocols. The relatively small aii^itional effort that would be res^nireci 
to study these effects would be coi^pensated for by the manifold ln«^«tsfes 
in knowledge and potential potency teacher edacation that could 



Didactic Issues in ^otocol DnlopMnt 
tte need a mat of guiding principles to iB^la w to d^lde how our 
conceptiisl MsipiM are to be plac#d in s#qttMBs^ mtd whetlisr si^V^Msir- 
tary Mterisls wa to hm «sed, and Imv thmf cmt bmmt be built into our 
teaching protMsL- A «ta|>le set of |ii Im ipi— ^ hmmd upon soaie 
teown and tssMd WHSftions about lessarta^ asii tzaasfer, are at 
hare. These piiiM^pisi ere delineatsd with Otar sBMsption that we ma 
talking about «ka teaching of a set af imtmrwm^mmd concepta^ each ^ 

Racevt sai rf ga af Snlth 0967), ^ubal OBM) t and Clsxk (19B^ 
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contain £«rtain parallel bs^r-r:*- ions about the t«jichung of concepts, 
^nilth imikI, for i»tance tn^ .n otigoing seconoar f<:hool lassrooms 
teacher- ind students devtr-^j^r i-::^atecies for conc«u rhat call upo:. 
three - . t^.^is of moves the cc*r rwr mav be describv^ jr it n.av be cow- 
pared v:^ other ccmcepts or f«M«nples of it mmy ^ven. Of cour^- 
sofne strKegies coHome wves of different types . MMbel enphasi 
the ImporLance of tnal Idiny clemr^ stable, una]ablgisa» meanings in 
nltive structure. Clark mi in saw simlar suggests. oae in his uses 
negative examples in the taachsaf mf concepts. The ::roduct of my think- 
ing about these didactic iMuea.^ basad largely upon tte writings of : 
three men identiriiad here, is rsm folloviaK two prdoacsples and their 
applicaclon to protacol praductson: 

1. The teacfalAg of a c mwpr alMmld begim ao^xti ^iear, simple 

sively throuipi 
ti ilaii com- 
ma Che parr of the 




in 



that 



1. 
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1 Use -TTOinpts or cues as necessarv • -TTiplify the concept. 

Labe. the concept . 
c. Sample all relewmt dimensi ^ac ^ aes. 
e. Pro liie for learner responding r example, and for 

feedback to him about the correctJMiK af his responses. 

2. ?-.lft other examples of the same concepr. 

RcBiAln with positive exair.ples of concept. 

In this stage, gradually eliminatse the prompts and cue&- 

c. With progressive examples, increw^i tiu stimulus complexity; 
include more irrelevant cues. 

d. Continue to give the learner a cbaaoti to reve^ the enent 
of hift leaxml^. 

3. Select a second, relaced cower t ^crr presentation, lelative 
to the fxrst coticept, this shoLjj w the MSt similar of th 
renaioim to be vreMAted. 

a. AgozzL. make «^ or lahtliac cues, p\ ripts, and other 
deriiMB to Tiop iJJy stimuli that imm learner must 
raopMd ISO. 

b. Use taooe\ mmk tfae text of ^^ur Mi^lM, to eaphaaiai 

and k^ifj tJkm Imi^Ic oiailjirities and jUf fereooo::. 
tbe-wr cooco^t tho oU. 

1 io o wpUiile»l#> im echaoa at c fom of cte Mm 
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Stage 1 

An acccpcing reaction by the teacher occurs when a response by a 
pupil, or a racing by a pupil, but usually a pupil response, is followed 
by a rating from the ::eacher that either clearly is positive, or less 
clearly admits the response, or which simply paraphrases or repeats the 
response, or «hich results in a qualification by the teacher. 

1.T0 kegin this protocol with the concept of positive rating. Vttien 
the tcscbgr gives a positive rating, which may be either verbal or non- 
verbal, ao do«bt is left that she unequivocally accepts the response 
(or rtflat) od the pupil. Although the behavior of interest typically 
occurs iMlirrli^ in a complex sequence of classroom interaction, the posi- 
tive racing la restricted to the pupil reaction (or rating) followed by 
the teacher's naction. 

Sm cxanfAa of such a cycle is given here: 

First gr^er: (reading haltingly) Ted throws the ball. 

Teacher: Good girl, Cathy! 

As we haw indicated » some or all of the exchange could be non-verbal. 
For exaaple, with a minor alterativ'>n, we would have the following, still 
an aasapla af paaitive rating. 

First grader: (reading haltingly) Ted throws the ball. 

Teachar : (Smiles , nods) . 

Stage 2 

In this stage, media is used to portray the examples. All examples 
are paaitive, and thay should be relatively clear and simple. Part of 
the apfcepriate strategy is gradually to increase complexity and reduce 
discriBinablllty during this stage. This can be done by (a) gradually 
raduciag labala, cmaa, and prompts, and (b) introducing examples that 
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are not restricted simply to the essentials of the concept being taught. 

The following example, if appearing on film, would be a good intro- 
duction to Stage 2. 

P: Andrew Johnson was impeached, he just wasn't convicted. 
That is, the Senate decided he wasn't guilty. 

T: Right on the head! That's a very good answer. 

From a semantic standpoint, this example is no different from the 
one given for Stage 1. In fact, it is more complex because it occurs 
within the normal context of an ongr .ag classroom. The developer would 
be very careful in introducing this stage to label and cue the episode 
appropriately. He must, however, be equally careful in seeing to it 
that by the close of this stage, the learner is independent in his abil- 
ity to identify and state criteria for episodes of this or somewhat 
greater stimulus complexity. Obviously this means the developer must 
be at pains to insure that learners are responding to appropriate ele- 
ments of the substance of episodes, and not Just to the cues or labels 
supplied in the early teaching episodes. 
Stage 3 

The tradition to Stage 3 is signalled by the complete absence of 
overlaid cues for positive examples, and by the introduction of negative 
examples, as well as less concern about controlling the noise level, or 
irrelevant stimuli that appear on film. For instance, embedded within 
the action of Stage 3, we might have episodes similar to the two that 
follow. 



EKLC 



21 



P: Jerry said the Republicans 



P: Another cause of unemployment 



won the election of 1912 » 



is that — veil, if a man doesn't 



but Wilson was a Democrat, 



have a job — you know~he can't 



Y#>s , he was • 



buy anything, and then that 



hurts business. 



Oh? Well, I see your point. OK. 



The example on the lefthaud side is unmistakably one of a positive 
rating because the teacher accepts the pupil's response unequivocally as 
correct. It lacks the enthusiastic modifiers (and presumably the intona- 
tion that signifies enthusiasm as well) which have accompanied the earlier 
examples. The example on the right is not a positive rating; therefore, 
a negative example. Actually, it is intended to portray "admitting", in 
which the teacher's reaction, not positive, is mildly accepting or equi- 
vocally positive. When the negative examples call for initial subtle dis- 
tinctions, cues may be provided, but they would be discontinued before 
the close of this stage. Stage 3 would not be complete until the learner 
can discriminate acceptable but less than totally clear examples of the 
concept to be learned from examples of other kinds of behavior that are 
similar to, but differ from the standard behavior on one or more dimensions. 

At Stage A, the learner should be capable of identifying any accept- 
able example of the concept as it appears in ongoing classroom behavior, 
even though it may be surrounded by negative ;;xamples and a high noise 
level, and using the concept to explain ongoing events • The developer's 
aim at this stage is to provide the student with aa natural a slice of 
claaarooai Ufa aa he can capture. The only constraint undar which he 
oparataa la that examplas of the concapt to ba laamad appear within the 
coQtaxt of the film. 
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>• of this analysis has h—n to apply • slapl* ch««rv of 
It to the particular rigors of dovolopMtiC Involved in c»># 
•rotocol macsrlals for toachor •4ucaclo«. Tho cikM>rv savs 
I dovslopor should b«tln cho dovolopMnt process by, first, 
••copt ho wlshoo to toach m carofulljr as h« Is ahlo to 
t of that precoas, lay out cho ^rtlculsr dlaoMlons and 
oocopt chat will nood to bo portrayod. rro« a practical 
tho dovolopMttt of a library of ap^royrlato osa^los Is 
dod. tiMa^los My com olChor froa obIscIm MCorlsls, 
ructod by cho dovolo^r. Thoy vlll toad to sugf^at to 
oMroCo t«iM Cho rMfo of •mm^lm choc Mac bo udllMd 
Is flhal MCorlals. 

•ccic aca»« of doMlspBWiC, ho hoflM with ■■MpUa of 
^ CMi^c Choc ar« m tl—r am4 m M«««i«M«l «• cm ho 
M. Tkmt alapltclty U coahlMd with •la^licicy u Mdia. 
lo. KUCod CMC Mf ho Mod ia Cho iaicial dMaUpMac 
roU parfMCly far all haOcraaad mUo. TIm daMlofMac 
MMCiat tiM laataar vitfc aaldpla aaaaplM af all cIm 
MaiaM af cho oaaaart- OrdtMrilf Hm davalapar'a acra- 
lard Maid ha ta arta^M dlMMlaM aiaaf a patk af Ui- 
m oaapla rt ty ta hai^tM cka pawikiUtjr far pMiciM 
w aMiipla ar aariM af aadH^Ua U Hm aaM. 
\*9mt 9i atata, arkitraHljr aailai iMca lta«a I, Mm 4a- 

t mt rM M oMraaaoM aoiM U cha hMl nw Md of hia 
• tfaltharatoljr UtradMad aaiH-aMapUa, ar oomcIm 
MMiH' llita U sat 4m», U a uattaal aaiM, MCtI 



th«r« I0 %9od M0urMc« thmt the Itarner Km a firm und^rstinding of 
thm tarMt concept in its range of dinensions and values* The Intro* 
duct ion of negative exaaplee at that tiM will help the learner to 
differentiate becveen the target concept and near relatives, as it were. 
If, hovever, negative exanples are introduced too soon, the chances are 
good that the developer vill create negative transfer instead of dis** 
crisination betveen concepts. 

The final stage of this todel is essentially a criterial one. The 
learner sees claasrooa behavior in all the richness and complexity that 
can be Metered 00 film, and identifies or selects exaaiples of the target 
concept to help interpret or explain the events portrayed in the protocol. 

Two final points auat be made in the interests of clarity. One ia 
that the stageo deecribed in this model are pvrely arbitrary, but have 
been imp seed beeayee they uould seem to provide some helpful benchmarka 
for thm developor. The other point is that the model described here vill 
mot and oommot proviie data of the type amd level required by the developer 
to make ompiricml dmciaione about the tramaitioo from one etage to the f««xt. 
It ehould be clear that euch data are needed throughout the developmentei 
eofuemce, amd umuld probably beat be generated by the uee of e email nuniber 
•f e^Jecte ^ provide feedback to the developer. ^ vieving end reepond- 
img to hie prelimiMry of forte, ^bout the nu^r of cpioodme required, emd 
hov they ehould be articulated, ome vlth amother. 

I have alao eufteeted the need for eltaruotive comceptual modele to 
fit Che gaoa i*m tho developer iriehoe to gemerata mu coucopu rathor 
than to emalyae amd portray eignificamt exiatimg omaa. 
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